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Abstract 

Background: This study evaluated the effectiveness of the contextualized EBP training program for Filipino physical 
therapists in terms of knowledge, skills, attitudes and behavior. 

Methods: A randomized controlled trial was designed to assess the effectiveness of the EBP training program. Fifty 
four physical therapists were randomly allocated to the EBP group (intervention) and waitlist (control) group. The 
EBP group had a one day face-to-face training with an online support, whilst the control was waitlisted. There were 
three measurement points which were pre, post, and three months post intervention for knowledge, skills and 
attitudes. Activity diaries were used to measure behavior. The diaries were collected after three months. Data 
analysis was by intention to treat in EBP domains of knowledge, skills and attitudes. 

Results: Fifty-four physical therapists were included in the study. Fifty two (52) completed the post training 
assessment and 26 completed the 3 months post training assessment for EBP knowledge, skills and attitudes. There 
were significant improvements in these domains in the EBP group from pre to post training and over a period of 
three months (p < 0.05) compared with the waitlist control group. Thirty seven (37) physical therapists completed 
their activity diaries over three months. Behavior significantly improved in the EBP group in terms of EBP behaviors 
(formulating PICO, searching, appraising and applying the evidence) when faced with both new/unique and usual 
case scenarios (p < 0.05). More physical therapists in the waitlist control group significantly performed non-EBP 
behaviors (asking doctors and reading textbooks) when faced with new/unique cases compared with the EBP 
group (p < 0.05). No differences were noted between groups regarding non-EBP behaviors (asking colleagues 
and doctors and reading textbooks) particularly when faced with usual cases. 

Conclusion: The contextually designed EBP training program for Filipino physical therapists was effective in 
improving knowledge, skills and attitudes to EBP from pre to post training. Improvements were also observed at 
three months post training in knowledge, skills, attitudes and behavior to EBP. This model of training can be 
modified as needed based on the needs of the local context. Findings need to be interpreted with caution due to 
study limitations. 

Current controlled trials: ISRCTN74485061 (Registration date: February 9, 201 1). 
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Background 

Achieving best patient outcomes and optimising use of 
health resources should be the goal of every health system, 
whether in developed or developing countries. The 
importance of using evidence to guide practice in health 
care has been on the international agenda for some 
20 years [1]. Evidence-based practice (EBP) has become 
an integral component of healthcare and strategies to en- 
sure that health care is underpinned by the best evidence 
are well established in most developed countries [2]. 
Moreover, in the developed world, training for health pro- 
fessionals to put evidence into practice (Evidence-based 
practice (EBP) programs) is widely available and regularly 
evaluated at undergraduate and post graduate levels, and 
for continuing professional development [3-5]. The evi- 
dence for many health interventions for the management 
of a range of conditions have been summarized, and made 
accessible for the use of health professionals, policy 
makers and patients [6-9] . Increasingly common are the 
development, implementation and evaluation of clinical 
guidelines based from the evidence and present recom- 
mendations for practice [10,11]. 

In developing countries, evidence-based practice is in 
its infancy. Whilst the principles of EBP are particularly 
relevant in developing countries to underpin health policy 
and health delivery, the growth of EBP has been slower in 
developing countries. Some reasons for the slow growth 
are lack of knowledge of, and skills in, EBP, limited to lack 
of evidence-base information on developing country 
conditions, lack of access to electronic databases, limited 
research capacity, and lack of time to do EBP related activ- 
ities [12-14]. Developing countries are also faced with more 
challenging concerns than developed countries regarding 
evidence-informed practice. These concerns are largely 
based on queries regarding the usefulness and relevance of 
EBP in local contexts [12,15-20]. Differences in practice, 
the nature of health systems, scarce health care and re- 
search resources and other local and context specific 
conditions, further constrain the relevance and applic- 
ability of EBP in developing countries. For instance, in 
the Philippines, the nature of physical therapy practice 
is different compared to other countries. Physical thera- 
pists in the Philippines are not first contact practitioners 
and are given a prescribed treatment for the patients by 
referring doctors who have specialized in rehabilitation 
medicine. This influences and at the same time challenges 
the way they think and treat patients [21]. 

Whilst there may have been efforts to introduce EBP 
into developing countries, there is no clear or practical 
approach to building capacity and promoting the use of 
EBP in local settings that results to improved behaviors 
[16-18]. With limited resources available (financial, facil- 
ities, manpower) and the cultural and contextual issues 
confronting individual developing countries, it is unlikely 



that health professionals would invest their money, time 
and efforts in learning and adapting the principles of 
EBP unless they are perceived to be relevant and useful 
to their practice or their patients, in their context. 

This paper presents the findings of research into a 
model of an EBP training program designed to build 
capacity and promote EBP among physical therapists in 
a developing country, the Philippines. The EBP training 
program in this study has been considered as a 'complex 
intervention' based on the Medical Research Council of 
the United Kingdom (MRC) definition of complex inter- 
ventions and informed by the stages in MRCs framework 
[22]. Complex interventions consist of multiple phases 
and components and each phase informs the next phase 
of the intervention [22]. To address the 'complexity' of 
complex interventions, methods to standardize these 
types of interventions were recommended by identifying 
the 'fixed/constant' and 'variable' components [23]. 'Fixed' 
components are regarded as the essential Junctions, while 
the 'variable' components are those that fit the needs and 
the context of the population and the local setting where 
they operate. The concept of standardizing complex inter- 
ventions into fixed and variable components, particularly 
in conducting EBP training, has been proposed in the 
literature [24] and applied to this model of EBP train- 
ing. The 'fixed' components of the EBP training were 
composed of the concepts and steps to EBP whilst the 
'variable' components were composed of the EBP Checklist 
(to make recommendations to referring doctors to support 
the use of evidence-based management), the online 
support, use of printed materials and more time for the 
practical sessions as the physical therapists need to be 
guided appropriately [21]. 

The objectives of this study were: 

1. To assess the effectiveness of the contextually-based 
EBP training program in improving knowledge, 
skills, attitudes and behavior of Filipino physical 
therapists; and 

2. To provide a tested model of continuing education 
and uptake of evidence relevant to Filipino physical 
therapists. 

Methods 

The detailed methods and study procedures underpinning 
this randomized controlled trial were published as a full 
study protocol [21]. A summary of the study methods is 
provided in this paper, for completeness. 

Ethics 

This study had ethics approval by the University of South 
Australia's Human Research Ethics Committee (protocol 
no. 0000021872). Written informed consents were formally 
obtained from the participants who took part in this study. 
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Design 

A randomized controlled trial was conducted, in which 
physical therapists from the Philippines were randomly 
allocated to an EBP group or a waitlist control group using 
computer generated random numbers. Assessments of 
EBP outcomes occurred at three time periods: pre- 
training, immediately post-training and three months 
after the training. Activity diaries were completed by 
both groups during the three month follow up period, 
during which time the EBP group also received support 
in terms of the EBP online support and an EBP checklist 
to recommend treatment interventions. 

Sample 

The participants were physical therapists in the Philippines 
recruited from a range of sources: a database of physical 
therapists obtained from a preliminary descriptive survey 
study [25,26], the network of the Philippine Physical 
Therapy Association and a list of hospitals in the yellow 
pages (telephone). Potential participants were screened for 
the following criteria: 

1. Licensed physical therapists and 

2. No previous formal EBP training. 

Sample size 

The sample size for this study was calculated from the 
findings of the pilot RCT [27] using Medcalc software. 
The primary outcome measure used as basis for sample 
size calculation was knowledge and skills using the 
Adapted Fresno Test. The pilot RCT resulted to a large 
effect size (0.80) which required only a sample of 10 par- 
ticipants. As we are uncertain what inflated the effect 
size, we decided to be conservative and used a moderate 
effect size (0.4-0.7) to compute for the sample size at 0.05 
level of significance and with an 80% statistical power. 
Fifty four (54) physical therapists were then required for 
this study. 

Randomization and blinding 

Once participants were screened for eligibility, an inde- 
pendent person randomly allocated participants into the 
EBP intervention group and the waitlist control group, 
using computer generated random numbers applied to 
the list of eligible participants. Allocation was concealed 
from the researchers of this study and to the assessors. 
The schedule of training was dependent on the group 
allocation such that the EBP intervention group was 
scheduled ahead and those in the control group were 
waitlisted, and provided with the training after the three 
month period of data collection has been completed. 
Those assessing the outcomes of the study were blinded 
at all times. 



Development of the intervention 

Preliminary studies were undertaken prior to this RCT 
to inform the development of the program and to identify 
specific strategies to enhance the delivery of the program 
to the participants. The EBP training program was entitled 
the 'EBP for FilPTs'. The training program was modelled 
as a complex intervention with "fixed/constant' and 'vari- 
able' components. It was also underpinned by theories of 
adult learning [28], educational strategies [29-32] and the 
evidence regarding the effectiveness of EBP training pro- 
grams [33]. It was then designed in the context of the 
needs of the physical therapists and the nature of the local 
practice [25,26] considering that they are not first contact 
practitioners. 

'Fixed' components 

The 'fixed' component of the EBP for FilPTs is the one day 
face-to-face training, in the form of lectures and practical 
sessions, consisting of the following lectures with support- 
ing practical sessions (to influence skills in EBP): 

1. Introduction to EBP 

2. Hierarchy of evidence and study designs 

3. Drafting the clinical question using the PICO format 

4. Designing the search 

5. Critical appraisal of the evidence and 

6. Answering the clinical question based from the 
evidence found. 

'Variable' components 

The 'variable components of the program are the EBP 
Checklist, the online EBP support, use of printed mate- 
rials and more time for practical sessions. The EBP 
Checklist (Additional file 1) is to make evidence-based 
recommendations to referring doctors. It contains items 
related to validity and applicability of the evidence, mag- 
nitude of effects and capacity of the physical therapist to 
deliver the evidence-based patient management. The 
online support can be accessed through http://unisa.edu.au/ 
Research/Sansom-Institute-for-Health-Research/Research- 
at-the-Sansom/Research-Concentrations/Allied-Health- 
Evidence/Quality-Care/EBPPhil/The-EBP-Training-Package 
and is for the use of physical therapists who lack time to 
search, and lack access to evidence based information. 
Physical therapist would also have access to the training 
materials (lectures and references) in case they need to re- 
fresh their knowledge regarding the EBP [21,25-27]. 

Outcome measures 
EBP knowledge and skills 

The Adapted Fresno Test (AFT) was used to measure 
changes in EBP knowledge and skills. It is reported to be 
a psychometrically-sound test especially among novice 
allied health professionals [34]. The AFT is composed of 
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clinical scenarios relevant to physical therapy and occupa- 
tional therapy and items related to formulating a question, 
identifying and searching for sources of evidence, identify- 
ing the best study type to answer the question and rele- 
vance, validity and significance of the evidence found. The 
AFT is scored using a scoring rubric and the total possible 
score is 156. The use of the AFT for this RCT was tested 
in the pilot RCT conducted prior to this study, where it 
was assessed for reliability (ICC = 0.99) between two 
assessors [27]. 

EBP attitudes 

The questions regarding EBP attitudes developed and 
used by Stevenson, Lewis and Hay (2004) [35] were ap- 
plied to measure changes in attitudes among the physical 
therapists in this study. These were questions related to 
changing practice if good quality evidence exists, support 
to undertake EBP activities, and confidence in searching 
the literature and undertaking critical appraisal. The ques- 
tions are to be answered by choosing whether the physical 
therapists agree, disagree or neither. This has been 
validated for content among physical therapists in the 
United Kingdom, and was found to be a valid measure 
of EBP attitudes [35]. 

EBP behavior 

Behavior regarding EBP was measured by activity diaries. 
The physical therapists in both groups were instructed 
to log their activities by placing a tick (V) in the options 
related to activities used to find the answer to a case 
they were faced with. The case could relate to a unique 
situation or to usual care. A unique case has been defined 
as a new one for the physical therapist, or a difficult or 
complex case such as a patient with Parkinson's disease 
who also had co-morbidities, making the condition 
complex. A usual case has been defined as a common 
case such as non-specific low back pain where there are 
multiple possible treatment interventions, and where the 
best intervention needs to be identified. The physical ther- 
apists were also instructed to write a short description of 
the case in the diaries. 

Data analysis 

Data were analysed using SAS version 9.2. For equal inter- 
val data, the findings were reported as medians, interquar- 
tile range and confidence interval for the median. For 
categorical data, findings were reported as percentages. 
Differences between groups were calculated using the 
Mann Whitney U test for interval data and Chi square test 
of proportion for categorical data. For all testing, p values 
were deemed to be significant if p < 0.05. Data analysis 
was by intention to treat for EBP knowledge, skills and 
attitudes but not possible for behavior. 



Results 

Study sample 

Sixty-eight potentially-eligible physical therapists expressed 
interest in taking part in the study. Fourteen did not attend 
the orientation and were not included in the random 
allocation process. A total of 54 physical therapists 
were randomized to the EBP training group (N = 27) 
and the waitlist control (N = 27) groups. Fifty four (54) 
physical therapists completed the pre-training assessments, 
52 (EBP group = 27, waitlist control group = 25) completed 
the post training assessments and 26 completed the 
3 months post training assessment (EBP group = 15, 
waitlist control group = 11). Of the 54 physical therapists in 
the study, 37 returned the behavior diaries (EBP group = 
18, waitlist control group = 19). See Figure 1. 

The physical therapists were similar at baseline in terms 
of age and the main study outcome (EBP knowledge and 
skills measured using the AFT), but different in terms of 
years of practice (Table 1). There were 12 (44%) females 
and 15 (56%) males in the EBP group and 17 (63%) females 
and 10 (37%) males in the waitlist control group. There 
was no difference in the proportion of females and males 
in both groups. 

Study outcomes (EBP domains) 
EBP Knowledge and skills 

Improvements in EBP knowledge and skills were found 
in the EBP group compared with the waitlist control 
group at immediate post-training and three months after 
the training, as shown in Table 2 and Figure 2 (using 
the median scores and 95% confidence interval for the 
median). 

The improvement in knowledge and skills of the EBP 
group was significant in all items of the AFT in over all 
time periods except for Q2 (Sources of information; 
advantages and disadvantages) at post training (Table 3). 

Attitudes 

No statistical difference was found between the EBP 
group and waitlist control group at pre-training for all but 
two of the EBP attitudes. This was regarding changing 
practice if good quality evidence exists, and confidence in 
undertaking a literature search. Whilst a slightly larger 
percentage of the EBP group agreed that practice should 
change if good quality evidence exists, none of the 
physical therapists (in either group) disagreed. Whilst 
a larger percentage of the control group agreed they 
lack confidence in undertaking a literature search, a 
larger percentage of the EBP group neither agreed nor 
disagreed, which implies that most of the physical ther- 
apists (in either group) were not really confident to do 
a literature search (Table 4). 

At immediate post-training and three months post- 
training, significant differences were found between the 



Dizon et al. BMC Medical Education 2014, 14:147 
http://www.biomedcentral.eom/1 472-6920/1 4/1 47 



Page 5 of 1 2 



Reference population: Registry of physical therapists from a preliminary profile survey, the Philippine Physical 
Therapy Association and list of hospitals in the yellow pages 



Eligibility criteria: 

1. Licensed physical therapists 

2. No EBP course or training (screening form) 








Eligible partici 
(N= 


3ants screened 
68) 


Excluded = (N=14) 
Did not attend orientation 







Total number of participants in 
included and randomized in the 
study (N=54) 



Allocated to EBP group 
N=27 



Allocated to waitlist control 
N=27 



Pre test assessment(N=27) 

1. Knowledge and skills (Adapted Fresno test by 
McCluskey and Bishop 2009) and 
2. Attitudes (Questions on Attitudes to EBP by 
Stevenson, Lewis and Hay 2004) to EBP 

One day EBP training 

Post EBP training assessment(N=27) 

1. Knowledge and skills (Adapted Fresno test by 
McCluskey and Bishop 2009) and 
2. Attitudes (Questions on Attitudes to EBP by 
Stevenson, Lewis and Hay 2004) to EBP 

3 month period support provided 

After 3 months (N=15) 

1. Knowledge and skills (Adapted Fresno test by 
McCluskey and Bishop 2009) and 
2. Attitudes (Questions on Attitudes to EBP by 
Stevenson, Lewis and Hay 2004) 
***Reasons for non-response were non-availability 
and refusal to complete the assessment 

Diaries (N=18) 



Pre test assessment(N=27) 

1. Knowledge and skills (Adapted Fresno test by 

McCluskey and Bishop 2009) and 
2. Attitudes (Questions on Attitudes to EBP by 
Stevenson, Lewis and Hay 2004) to EBP 

Waitlisted for the EBP training 

Post EBP training assessment(N=25) 

1. Knowledge and skills (Adapted Fresno test by 
McCluskey and Bishop 2009) and 
2. Attitudes (Questions on Attitudes to EBP by 
Stevenson, Lewis and Hay 2004) to EBP 

3 month period waitlisted for the training 

After 3 months (N=ll) 

1. Knowledge and skills (Adapted Fresno test by 
McCluskey and Bishop 2009) and 
2. Attitudes (Questions on Attitudes to EBP by 
Stevenson, Lewis and Hay 2004) 
***Reasonsfor non-response were non-availability 
and refusal to complete the assessment 

Diaries (N=19) 



Analysed 
N=27 



Analysed 
N=27 



Figure 1 Consort diagram. 



EBP training for the control group 



groups in terms of attitudes, specifically in terms of the 
following EBP activities: 

1. Lacking confidence in undertaking a literature 
search (more physical therapists disagreed to this in 
the EBP group than the control group) and 



2. Confidence in undertaking a critical appraisal (more 
physical therapists agreed to this in the EBP group 
than the control group). 

Interestingly, it could be noted that there was also an 
increase in number in these attitudes items in the control 
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Table 1 Characteristics of the physical therapists at pre-training 



Characteristics 


EBP group (N = 27) 
(median, IQR) 


Waitlist control group (N = 27) 
(median, IQR) 


P value 


Age (years) 


29.0 (26-36) 


28.0 (25-30) 


0.05 


Years in practice 


4.2 (2-7.75) 


3.0 (1.13-4) 


0.04* 


Adapted Fresno Test (AFT) Scores 


1 1 .0 (8.0-32.5) 


21.0 (5.0-29.5) 


0.97 



^significant p value; Mann- Whitney (J test was used to calculate for differences between groups. 



group at post training period. Possible reasons are ex- 
plored in the discussion section. 

EBP behavior 

A total of 37 physical therapists submitted their diaries 
for analysis (EBP group =18, waitlist control group =19). 
Of the 18 diaries from the EBP group, 16 had reported 
cases (unique cases = 14, usual cases = 9) and 2 did not 
contain any documented activity. Of the 19 diaries from 
the waitlist control group, 13 had reported cases (unique 
cases = 10, usual cases = 10) and 6 did not contain any 
documented activity. For the purpose of reporting, the 
activities were categorized as to EBP behaviors (formu- 
lating PICO, logging PICO, searching research evidence, 
appraising evidence and applying the evidence) and non- 
EBP behaviors (asking colleagues, asking medical doctors 
and reading textbooks). 

a. Unique cases 

Fourteen physical therapists from the EBP group 
and ten from the waitlist control group reported to 
have had unique cases. For unique cases seen, more 
physical therapists in the EBP group significantly 
performed EBP behaviors (such as formulating their 
PICO, logging a PICO, searching for research 
evidence, appraising and applying the evidence) 
compared with the waitlist control group. More 
physical therapists in the waitlist control group 
significantly performed non-EBP behaviors (such as 
asking medical doctors and reading textbooks). No 
difference was noted between groups in terms of 
asking colleagues (Table 5). 



b. Usual cases 

Nine physical therapists from the EBP group and ten 
from the waitlist control group reported to have had 
usual cases. For usual cases seen, more physical 
therapists in the EBP group significantly performed 
EBP behaviors (such as formulating their PICO, 
searching for research evidence, appraising and 
applying the evidence) compared with the waitlist 
control group. No difference was noted between 
groups in terms of the non-EBP behaviors (asking 
colleagues, asking MDs and reading textbooks 
(Table 6). 

Discussion 

This is the first known randomized controlled trial to be 
undertaken in the field of allied health, in terms of asses- 
sing the effects of a carefully designed, context-specific 
EBP training program which measured change in all EBP 
domains of knowledge, skills, attitudes and behavior. This 
is also the first study to assess the impact of an EBP train- 
ing intervention among physical therapists in a developing 
county, the Philippines. 

The EBP training program delivered to the physical 
therapists was developed from a series of preliminary 
studies that informed the design and components of the 
intervention. The program resulted in improvements in 
EBP knowledge, skills, attitudes and behavior (evidence 
seeking) immediately after the training and over a three 
month period of providing support and observation. How- 
ever, these findings need to be interpreted with caution 
due to the number of drop outs in the three months post 
training assessment. 



Table 2 Changes in EBP knowledge and skills 



AFT scores 


EBP group (N 


= 27) 


Control group (N 


= 27) 


P value 


(total = 0-1 56) 


Median, IQR 


95% CI 


Median, IQR 


95% CI 


Pre training 


11.0 


9.0-21.0 


21.0 


7.9-26.1 


0.97 


(8.0-32.5) 


(5.0-29.5) 


Post training 


68.0 


53.0-72.0 


20.0 


1 1 .0-30.0 


<0.0001* 


(51.5-76.8) 


(9.3-30.8) 


3 months post training 


53.0 


42.0-69.1 


9.0 


9.0-15.2 


<0.0001* 


(39.2-71.8) 


(8.0-27.5) 



^significant p value; Mann- Whitney U test was used to calculate for differences between groups. 
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3months post 
training 



Figure 2 Changes in EBP knowledge and skills of physical 
therapists. 



Changes in EBP knowledge and skills 

The EBP training program resulted in significant im- 
provement in EBP knowledge and skills at post-training. 
At three months post training, whilst there were also 
improvements in these domains, it can be noted that 
there were fewer physical therapists assessed at this 
point, thus the improvements reported may not exactly 
reflect the true effect of the intervention at this point of 
assessment. Nonetheless, the improvement in these EBP 
domains could be expected due to the low pre-training 
scores, and the naive EBP nature of the participants. 
The physical therapists in the Philippines who partici- 
pated in the study had no prior and formal training in 
EBP, thus, it is expected that after undertaking the 
training, scores in the knowledge and skills test would 
improve. The findings of this study are similar to those 
of other similar studies, which provided EBP training 
programs to other allied health professionals and 
assessed the impact of the training in terms of know- 
ledge and skills. These were the studies on occupa- 
tional therapists [36] and social workers [37] which 
both reported improvements in EBP knowledge and 
skills immediately post-training and after three months 
[37] and eight months follow-up respectively [36]. Any 
EBP training program delivered to any health professional 
can result in improved knowledge and skills as there is 
(presumably) new knowledge being provided to the 
participants [3,4]. 

In comparing our study with the findings of a study 
among occupational therapists which also used the AFT 
of knowledge and skills [36], participants in our study 
had lower pre-training scores compared to the occupa- 
tional therapists. The study on occupational therapists 
had no eligibility restrictions regarding prior training in 
EBP, thus, the occupational therapists could have prior 
training in, or exposure to, EBP resulting to higher pre- 
training AFT scores. In both studies, knowledge and 
skills improved post training. 



Changes in EBP attitudes 

Physical therapists in both groups had common beliefs 
regarding underpinning practice with the best evidence 
and changing practice, if good quality evidence suggests 
that changes in practice should be made. However, in the 
post-training assessments, the EBP group was significantly 
more confident in undertaking literature searching and 
critical appraisal. These findings occurred as expected as 
an effect of the EBP training program, wherein the phys- 
ical therapists in the EBP group had lectures and practical 
sessions on designing a search strategy and critically 
appraising the literature. Same results were found at 
three months post-training. These were further validated 
in the analysis of the diaries where there were EBP be- 
haviors related to searching for evidence and appraising 
the evidence. However, due to lesser number of physical 
therapists assessed at this point, these findings should 
be interpreted with caution. 

The improved attitudes in EBP in this study are similar 
to other studies on physical therapists (Stevenson et al. 
2004) [35], occupational therapists [36] and social workers 
[37] but contradicting findings from a study of a mixed 
group of health professionals [1]. The common charac- 
teristic of this study and the studies amongst physical 
therapists, occupational therapists and social workers 
that might have influenced the improvement in EBP atti- 
tudes was that the training provided to the allied health 
professionals included additional strategies or components 
(such as opinion leaders and support for the EBP activ- 
ities), other than just teaching the basic steps to EBP or 
specific skills such as critical appraisal. 

An interesting finding in this study relating to attitudes 
in EBP was the increase in number (though insignificant) 
of physical therapists in the waitlist control group at post 
training who agreed to be more confident in undertaking 
literature search and critical appraisal. It could possibly be 
that the physical therapists in the control group attempted 
to read on these items after the pre-training assessment 
period and perceived that they are able to perform 
such activities. It could also be related to social desir- 
ability bias, where respondents answer favorably to self 
report assessments because they know that the answers 
are socially acceptable or the answers are the target 
responses [38]. However, in this study, the issue on 
whether the physical therapists have accessed informa- 
tion on searching and appraising evidence and feel 
confident in doing such activities, or have exhibited so- 
cial desirability bias in these attitudes, is addressed and 
validated by the use of an objective and psychometric- 
ally tested Adapted Fresno Test. In Questions 4 
(searching) and 6 (assessing for validity of the evi- 
dence) of the AFT, median scores were zero as there 
were no answers in the test that could be given points 
for evidence of knowledge and skills on searching and 



Table 3 Changes in EBP knowledge and skills of the EBP group in each item of the AFT over time periods 




Pre training scores 






Post training 




3 months post training 






(median, IQR) 






(median, iijkj 






(median, IQR) 




Questions in the AFT 


tor 

group 


waitlist 
control 


Pre 
training 


EBP 
group 


Waitlist 
control 


Post 
training 


tor 

group 


waitlist 
control 


3 months 
post training 




(N = 27) 


(N = 27) 


(p value) 


(N = 27) 


(N = 27) 


(p value) 


(N = 27) 


(N = 27) 


(p value) 


Q1 (0-12 points) 

Writing a focused question using the PICO 


—5.0 (3.0- 7.8) 


5.0 (3.0-6.0) 


0.4 1 


10.0 (9.0-12.0) 


6.0 (3.0- 8.8) 


0.0001 * 


9.0 (9.0-12.0) 


4.0 (3.0-6.8) 


0.0001* 


Q2 (0-24) 

Sources of information; advantages and disadvantages 


— 6.0 (4.0-8.0) 


7.0 (0.0-10.0) 


0.87 


8.0 (6.0-13.5) 


6.0 (2.0-10.0) 


0.1036 


8.0 (6.0-13) 


4.0 (2.0-7.5) 


0.0006* 


Q3 (0-24) 

Study design that would answer the question 


— 0.0 (0.0-6.0) 


0.0 (0.0-5.3) 


0.98 


12.0 (12.0-12.0) 


0.0 (0.0-6.0) 


<0.0001* 


12.0 (6.0-12.0) 


0.0 (0.0-2.3) 


0.0005* 


Q4 (0-24) 
Search strategy 


— 0.0 (0.0-2.3) 


0.0 (0.0-7.5) 


0.48 


12.0 (6.0-15.5) 


0.0 (0.0-6.0) 


0.0001 * 


8.0 (6.5-14.0) 


0.0 (0.0-3.0) 


<0.0001 * 


Q5 (0-24) 

How is relevance of the study determined? 


— 0.0 (0.0-0.0) 


0.0 (0.0-0.0) 


0.96 


5.0 (5.0-14.0) 


0.0 (0.0-5.0) 


0.0002* 


5.0 (0.0-14) 


0.0 (0.0-4.5) 


0.0038* 


Q6 (0-24) 

How is validity of the study determined? 


— 0.0 (0.0-0.0) 


0.0 (0.0-0.0) 


0.77 


10.0 (5.0-10.0) 


0.0 (0.0-0.0) 


<0.0001* 


5.0 (0.0-10.0) 


0.0 (0.0-0.0) 


0.0005* 


Q7 (0-24) 

How are magnitude and significance determined? 


0.0 (0.0-0.0) 


0.0 (0.0-0.0) 


0.70 


5.0 (5.0-9.0) 


0.0 (0.0-0.0) 


0.0001* 


5.0 (1.3-5.0) 


0.0 (0.0-0.0) 


<0.0001* 



^significant p value; Mann- Whitney U test was used to calculate for differences between groups. 
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Table 4 Changes in EBP attitudes 









Pre-training 






Post training 




3 months post training 


Attitudes questions 




EBP 

(N = 27) 


Control 

(N = 27) 


P value 


EBP 

(N = 27) 


Control 
(N = 27) 


P value 


EBP 

(N = 27) 


Control 
(N = 27) 


P value 




Agree 


26 


27 




26 


26 




26 


27 




Clinical practice should be based 
on the best available evidence 


(96.3%) 


(100%) 




(96.3%) 


(96.3%) 




(96.3%) 


(1 00%) 




Disagree 


0 


0 


>0.05 


0 


0 


>0.05 


0 


0 


>0.05 


Neither 


I 






1 


1 




1 








(3.7%) 


— 0 




(3.7%) 


(3.7%) 




(3.7%) 


- 0 






Agree 


25 


20 




27 


23 




26 


23 




We should change our practice 
if good quality evidence suggests 


(92.6%) 


(74.1%) 




(100%) 


(85.2%) 




(96.3%) 


(85.2%) 




Disagree 


0 


0 


<0.05 


0 


0 


>0.05* 


0 


0 


>0.05 


we should 


Neither 


2 


7 




0 


4 




1 


4 






(7.4%) 


(25.9%) 




(14.8%) 




(3.7%) 


(14.8%) 






Agree 


2 


5 




0 


4 




2 


3 






(7.4%) 


(18.5%) 




(14.8%) 




(7.4%) 


(11.1%) 




would find it difficult to change 


Disagree 






>0.05 






<0.05* 


22 


16 


>0.05 


what I a rpsn\/ Hn in r inifa nrartirv^ 
vvi id l i aiicauy uu u i ljii iiL.ai uidL.LiLC 










(81 .5%) 


(52.3%) 




Neither 


8 


/ 




2 


4 




3 


8 






(29.6%) 


(25.9%) 




(7.4%) 


(14.8%) 




(1 1.1%) 


(29.6%) 






Agree 


1 1 


10 




18 


12 




15 


15 






(40.7%) 


(37.0%) 




(66.7%) 


(44.4%) 




(55.6%) 


(55.6%) 




I have support form management 


Disagree 


2 


2 


>0.05 


0 


1 


>0.05 


4 


- 0 


>0.05 


tn i i n H ft a L'fi FRP 


(7.4%) 


(7.4%) 


(3.7%) 


(14.8%) 






Neither 


1 1 


15 




9 


14 




8 


12 






(40.7%) 


(55.6%) 




(33.3%) 


(51.6%) 




(29.6%) 


(44.4%) 






Agree 


9 


1 / 




1 


/ 




0 


1 1 






(33.3%) 


(63.0%) 




(3.7%) 


(25.9%) 






(40.7%) 




1 would lack confidence in 


Disagree 


6 


4 


<0.05* 


25 


14 


<0.05* 


26 


9 


<0.05* 


U I ILtcl Ldl\l I ig d ILadLUIc ScdILII 


(22.2%) 


(14.8%) 


(92.6%) 


(51.6%) 


(96.3%) 


(33.3%) 




Neither 


1 ~i 
1 z 


0 




I 


o 




1 


7 






(44.4%) 


(22.2%) 




(3.7%) 


(22.2%) 




(3.7%) 


(25.9%) 






Agree 


2 


2 




24 


14 




24 


9 






(7.4%) 


(7.4%) 




(88.9%) 


(51.6%) 




(88.9%) 


(33.3%) 




would feel confident in undertaking 
a critical appraisal 


Disagree 


17 


13 


>0.05 


0 


6 


<0.05* 


0 


9 


<0.05* 


(63.0%) 


(48.1%) 


(22.2%) 


(33.3%) 




Neither 


8 


12 




3 


7 




3 


9 






(29.6%) 


(44.4%) 




(11.1%) 


(25.9%) 




(11.1%) 


(33.3%) 





^significant p value; Chi-Square test of proportion was used to calculate for p values. 



appraising the evidence among those in the waitlist 
control group. 

Changes in EBP behavior 

From the diaries collected from the physical therapists 
at three months post training, there were more physical 
therapists in the EBP group who performed EBP behaviors 
compared with the waitlist control group. Formulating a 
clinical question and searching for a research article were 
the most common EBP behaviors reported by the physical 



therapists. Logging a PICO was not as common as formu- 
lating a question and searching research evidence because 
the physical therapists only logged their PICO if they 
needed assistance in searching for the best evidence from 
the researchers (part of the online support intervention). 
Most of the physical therapists retrieved their own evidence 
as seen in the number of those searching for evidence. 
Formulating a clinical question using PICO, logging PICO 
as needed and searching for research evidence all relate to 
evidence-seeking behaviors. Appraising and applying the 
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Table 5 Comparison of behavior performed by the physical therapists when faced with new or unique cases 





EBP group (N = 14) 


Waitlist control group (N = 10) 


P value 


EBP behaviors when faced with new/unique cases 


Physical therapists who formulated PICO 


1 1 (78.6%) 


0 (0%) 


0.0001* 


Physical therapists who logged PICO 


4 (28.6%) 


0 (0%) 


0.037* 


Physical therapists who searched research evidence 


10 (71.4%) 


3 (30%) 


0.04* 


Physical therapists who appraised evidence 


4 (28.6%) 


0 (0%) 


0.037* 


Physical therapists who applied evidence 


4 (28.6%) 


0 (0%) 


0.037* 


Non-EBP behaviors when faced with new/unique cases 


Physical therapists who asked colleague 


1 1 (78.6%) 


8 (80%) 


0.93 


Physical therapists who asked MD 


6 (42.9%) 


10 (100%) 


0.003* 


Physical therapists who read textbooks 


8 (57.1%) 


10 (100%) 


0.017* 



*significant p value; Chi-Square test of proportion was used to calculate for p values. 



evidence to an actual patient case, which relates to 
practice behaviors, were also significantly noted in both 
groups. However, fewer physical therapists reported to 
have undertaken these practice behaviors as expected, as 
the physical therapists were not first contact practitioners. 
It is necessary to obtain a referring doctor's approval prior 
to making changes in prescribed treatment. However, this 
study indicated that there were some physical therapists 
that were able to apply the evidence and negotiate treat- 
ment choices with the referring doctors and other health 
professionals, using the EBP checklist. This highlights that 
it is possible to still apply the evidence in practice despite 
a cultural discipline-based hierarchy. Thus being non-first 
contact practitioners should not be a barrier to delivering 
treatment with the best evidence. However, this sce- 
nario could have occurred in practice setting where the 
organization/department and the health professionals 
in the department had open discussions regarding patient 
care. Environmental or organizational context plays a major 
role in the potential for EBP activities to take place [11]. 

It was also observed that whilst the physical therapists 
in the EBP group made more EBP behaviors, they were 



still adopting non-EBP behaviors such as asking a col- 
league, a medical doctor and reading textbooks. This is 
usual practice and therefore arguably difficult to change 
quickly or sustainably. Changing usual practice behavior 
takes time, and multiple strategies and ongoing input 
are required in order to make the change sustainable 
[11,39-41]. What were mostly addressed in the EBP training 
provided to the physical therapists were a small number 
of the EBP domains discussed by Michie et al. [42], these 
being knowledge, skills, environmental context, social/ 
professional role identity and social norms. There are more 
domains that need to be considered to fully influence be- 
havior change which are beliefs about capabilities, motiv- 
ation and goals amongst others [42]. However, whilst the 
EBP training may have only covered some domains of be- 
havior change, it is pleasing to note that the physical ther- 
apists in the EBP group had more EBP-behaviors than 
non-EBP behaviors, compared with the control group. 

It is important to note that whilst there were more 
EBP behaviors made by the EBP group in this study, the 
findings reflect only those physical therapists whose 
diaries were available for analysis. Diaries which were 



Table 6 Comparison of behavior performed by the physical therapists when faced with usual cases 





EBP group (N = 9) 


Waitlist control group (N = 10) 


P value 


EBP behaviors when faced with usual cases 


Physical therapists who formulated PICO 


8 (88.9%) 


0 (0%) 


0.00009* 


Physical therapists who logged PICO 


2 (22.2%) 


0 (0%) 


0.16 


Physical therapists who searched research evidence 


9 (100%) 


3 (30%) 


0.0016* 


Physical therapists who appraised evidence 


3 (33.3%) 


0 (0%) 


0.04* 


Physical therapists who applied evidence 


4 (44.4%) 


0 (0%) 


0.018* 


EBP behaviors when faced with usual cases 


Physical therapists who asked colleague 


7 (77.8%) 


8 (80%) 


0.906 


Physical therapists who asked MD 


4 (44.4%) 


7 (70%) 


0.26 


Physical therapists who read textbooks 


7 (77.8%) 


7 (70%) 


0.70 



^significant p value; Chi-Square test of proportion was used to calculate for p values. 
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not available or not returned for analysis may have a 
similar, or different set of behavior. 

Limitations of the study 

The sampling frame and the number of drop outs espe- 
cially at the three months post training assessment con- 
strains making a general conclusion about the impact of 
the EBP training for physical therapists in the Philippines. 
However, there is an indication of the improved outcomes 
of targeted EBP training but only to the sample in this 
study from which the outcomes were obtained. Data 
regarding reasons for drop out or non-compliance was 
not available in this study but may be good to collect in 
future studies to further understand behaviors of the 
physical therapists and inform the design of training pro- 
grams in the future. 

Implications for practice 

On the findings of this study, physical therapists can 
benefit from the training in terms of knowledge, skills, 
attitudes and behavior in EBP. Lack of awareness and lack 
of knowledge and skills in EBP are identified barriers espe- 
cially in developing countries. The model of EBP training 
in this study has the potential to address these to barriers 
which may be regarded as "baby steps" to getting evidence 
into practice and may not translate to improved EBP be- 
havior in most cases, but is still worth having as an initial 
platform to build EBP capacity. 

Implications for research 

This model of EBP training program has been tested 
among physical therapists who were not first contact 
practitioners and there is some benefit in its use. Future 
research needs to focus on targeting more individuals to 
improve the sampling frame and improving intervention 
strategies and monitoring to complete post test measure- 
ments. The EBP training program can also be modified as 
required, delivered and then evaluated in context in future 
studies. 

Conclusion 

This training program took the form of a complex 
intervention, by providing context-specific EBP training 
program for Filipino physical therapists (EBP for FilPTs) 
which can be modified as needed by local context. There 
were improved outcomes of EBP domains immediately 
post training, and to some extent, at three months post 
training. However, findings still need to be interpreted 
with caution due to the limitations of the study. 

Additional file 

Additional file 1: EBP Checklist. 
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